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ABSTRACT 

Motivated  by  the  Navy’s  emphasis  on  networked  planning  capabilities  in  maritime 
operations  centers  (MOC),  we  have  developed  an  agent-based  multi-level  resource 
allocation  model  that  takes  high  level  commands  from  the  human  planners  and  then 
dynamically  allocates  the  lower-level  assets  and  processes  tasks  to  accomplish  the  mission 
objectives.  The  agent-based  model  supports  a  controllable,  multi-player,  real  time 
collaborative  planning  environment  in  a  Windows  environment.  The  architecture  allows 
for  adding  constraints  on  and  manipulations  of  organizational  structures,  such  as  authority, 
information,  communication,  resource  ownership,  task  assignment,  as  well  as  mission  and 
environmental  structures.  The  planning  problem  is  formulated  as  a  multi-level 
optimization  problem  of  minimizing  the  overall  difference  between  the  human  specified 
performance  measures  and  expected  performance  measures  which  are  evaluated  based  on 
how  well  the  assigned  resources  match  the  required  resources,  subject  to  a  number  of  real- 
world  planning  constraints  on  assets.  We  applied  a  Dynamic  List  Planning  algorithm 
(DLP)  to  solve  the  intractable  multi-level  resource  allocation  problem.  The  near-optimal 
DLP  method  can  generate  high-quality  solutions  in  seconds  compared  to  days  taken  by  the 
branch-and-bound-based  search  methods. 

Keywords:  Collaborative  planning,  Dynamic  List  Planning,  Maritime  operations  centers, 
Multi-level  asset  allocation  problem 


L  INTRODUCTION 

Motivation 

The  Navy’s  new  concept  of  incorporating  maritime  headquarters  with  maritime  operations 
centers  (MOC)  emphasizes  standardized  processes  and  methods,  centralized  assessment 
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and  guidance,  networked  distributed  planning  capabilities,  and  decentralized  execution  for 
assessing,  planning  and  executing  missions  across  a  range  of  military  operations  [1].  The 
planning  process  is  informed  by  guidance  from  higher-level  headquarters  and  the 
assessment  process.  It  is  collaborative  both  vertically,  with  higher-level  headquarters  and 
lower-level  subordinates,  and  horizontally,  with  other  MOCs  and  joint  components.  The 
maritime  planning  processes  focus  on  the  desired  objectives  and  operational  effects 
specified  by  higher-level  headquarters’  guidance.  A  MOC  does  not  “own”  any  forces,  but 
rather  gives  directives  to  subordinate  commands  and  forces.  The  primary  tool  for  the 
MOC  will  be  the  collaborative  information  environment  (CIE).  Important  to  effective 
execution  is  operational  environment  awareness,  horizontal  and  vertical  integration  with 
other  commands  and  continuous  assessment.  Coordination  and  collaboration  play  a  key 
role  in  the  MOC’s  distributed  planning  environment  [2], 

Organizational  decision-making,  including  the  process  of  recognizing  when  and  how  to 
adapt,  is  a  complex,  knowledge  intensive  process  [4],  In  order  to  study  the  coordination 
behavior  among  planners  and  to  mimic  operational  planning  processes  in  the  MOC,  we 
have  developed  an  agent-based  multi-level  resource  allocation  model  that  takes  high-level 
commands  from  the  human  planners  and  then  dynamically  allocates  the  lower-level  assets 
and  schedules  tasks  to  accomplish  the  mission  objectives.  It  is  an  interactive  decision  aid 
to  facilitate  the  planning  process  in  MOC  architecture.  The  overarching  objective  is  to 
have  an  analytical  framework  or  paradigm  that  facilitates  experimentation, 
analytical/normative  modeling  of  task-asset  allocation,  supports  collaboration  and 
coordination,  and  software  agents  to  solve  the  task-asset  allocation  problem  at  the 
subordinate  task  force  (STF)  level. 

This  paper  focuses  on  the  human-synthetic  agent  system  which  enables  human  Decision 
Makers  (DM)  to  perform  creative  tasks  at  the  operational  level  planning.  Specifically, 
humans  allocate  sub-ordinate  task  forces  to  tasks  and  make  decisions  to  adapt 
organizational  elements,  while  the  synthetic  agents  provide  information  and  decision 
support  to  human  DMs  by  allocating  resources  at  the  tactical  level  based  on  the 
commander’s  intent.  The  latter  involves  performing  tactical  resource  allocation  subject  to 
mission  constraints.  We  consider  three  components  that  have  been  proven  to  have  relevant 
impact  on  operational  level  planning  processes: 

1)  Mission  environment; 

2)  Organizational  structure;  and 

3)  Supporting-supported  relationships  within  the  mission-specific  organizational 
structure. 

A  human-in-the-loop  planning  tool  is  instrumental  in  facilitating  collaborative  planning. 

Related  Research 

Our  foray  into  distributed  planning  started  with  the  MOC-oriented  human-in-the-loop 
planning  experiment  (MOC-1)  conducted  at  NPS  in  March  2009.  This  experiment  was 
designed  to  examine  alternative  structures  and  processes  for  coordination  of  planning 
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activities  among  three  key  cells:  Future  Operations  (FOPS),  Current  Operations  (COPS), 
and  Intelligence  Surveillance  and  Reconnaissance  (ISR)  necessary  to  operationalize  a  plan 
generated  by  a  Future  Plans  Cell.  The  FOPS  cell  drove  this  experiment  -  its  goal  was  to 
develop  the  “plan”  for  allocating  assets  across  a  number  of  interdependent  future  tasks.  As 
part  of  this  experiment,  we  developed  two  optimization-based  modules  that  focused  on  the 
Future  Operations  (FOPS)  cell’s  planning  activities  and  Current  Operations’  (COPS)  Risk 
Analysis.  The  FOPS  Planning  Module  is  a  decision  aid  that  presents  the  planners  with  N- 
best  asset  packages  that  would  meet  individual  task  requirements,  while  maximizing  task 
execution  accuracy,  to  assist  the  human  player  in  generating  an  effective  (measured  in 
terms  of  task  accuracy)  and  efficient  (measured  in  terms  of  task  completion  times)  plan. 
The  ISR  and  COPS  cells  supported  this  activity  by  obtaining  and  providing  relevant  task 
information  needed  by  FOPS  to  construct  the  plan.  We  also  proposed  an  optimization- 
based  scheduling  algorithm  that  was  used  by  experiment  designers  to  set  the  conditions 
for  the  mission  planning  activity  (e.g.,  asset  types  and  numbers,  task  requirements  and 
asset  capabilities),  and  to  assure  that  the  tasks  presented  to  the  human  planners  would 
indeed  be  achievable  to  a  specified  degree  of  accuracy.  Current  Operations  (COPS)  Risk 
Analysis  module  was  also  implemented  to  assist  COPS  players  on  the  consequences  of 
redirecting  assets  from  an  ongoing  task  to  perform  ISR  tasks  and  unforeseen  tasks 
requiring  immediate  attention  [1][3]. 

The  problem  of  allocating  assets  to  tasks,  in  its  most  simplified  form,  is  a  well-known 
assignment  problem  [5].  When  there  are  a  large  number  of  assets  available  and  if  they  can 
be  combined  into  different  asset  packages,  it  is  related  to  the  Cutting  Stock  problem  [6]. 
There  exist  many  optimization  tools  that  provide  solutions  to  such  allocation  problems 
(e.g.  Lpsolver,  ILOG  CPLEX,  LINGO,  etc.).  Motivated  by  the  hierarchical  organization 
of  assets  [4]  [7]  [8]  [9],  the  present  paper  solves  a  multi-level  asset  allocation  problem, 
which  generates  the  assignment  relationships  between  the  each  level’s  assets  and  the  tasks. 

Organization  of  the  Paper 

This  paper  is  organized  as  follows.  Section  II  explores  the  components  of  Operational 
level  planning,  and  introduces  a  mission  environment  model,  the  basic  concepts  in  multi¬ 
level  asset-task  modeling  paradigm,  organizational  hierarchy  and  supporting-supported 
relationships.  The  allocation  problem  for  MOC-2  experiment  is  formulated  in  Section  III. 
Herein,  the  optimization  objective  is  one  of  minimizing  the  difference  between  the 
assigned  accuracy  based  on  the  assignment  array  and  the  desired  accuracy  specified  by 
human  players.  A  heuristic  approach,  termed  the  Dynamic  List  Planning  method,  is 
applied  to  the  problem  in  Section  IV.  The  experiment  design  and  results  are  presented  in 
Section  V.  Finally,  the  paper  concludes  with  a  summary  of  key  findings  and  future 
research  directions  in  section  VI. 

II.  Components  of  Operational  Level  Planning 

Mission  Environment 
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Figure  1  Mission  Task  Graph  for  Area  A 


In  the  MOC  experiment  [4]  conducted  at  Naval  Postgraduate  School  (NPS),  there  were 
two  cells:  the  FOPS  (Future  Operations)  and  the  COPS  (Current  Operations).  The 
experiment  was  to  build  an  effective  plan  by  allocating  Task  Forces  (TF)  to  a  task, 
monitoring  the  performance  of  the  task  and  then  re-planning  on  the  next  day  for  the 
ongoing  task  based  on  the  performance  at  the  end  of  previous  day.  The  experiment  was 
conducted  with  six  teams  for  a  six  day  planning  time  window  starting  with  Day  0  and 
ending  with  Day  5.  There  were  four  FOPS  players  in  each  team.  The  experiment  was 
performed  under  two  conditions:  integrated  team  where  the  teams  planning  for  Area  A 
were  aware  of  plans  for  Area  B  and  isolated  team  where  the  two  teams  were  planning 
separately.  Both  teams  were  given  the  agent-based  software  decision  support  tool  that 
encouraged  coordination  (integrated)  or  reduced  coordination  (isolated).  The  FOPS  team 
worked  on  developing  a  plan  for  both  geographical  Areas  A  and  B  for  time  blocks  of  Day 
(T  +  1)  and  Day  (T  +  2),  whereas  the  COPS  cell  monitored  the  plan  for  current  play 
session  (i.e.,  Day  T)  and  send  status  updates  to  the  FOPS  as  situational  reports  for  the 
assets  and  the  task  which  represented  the  true  information  from  the  battlefield.  The 
planning  for  each  team  was  further  subdivided  into  subteams,  where  each  FOPS  player 
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was  either  responsible  for  Area  A  or  for  Area  B  tasks.  Since  they  worked  with  the  same 
set  of  assets  for  different  planning  blocks  and  as  there  may  not  be  adequate  assets  to 
complete  all  tasks  with  desired  accuracy,  they  needed  to  coordinate  to  generate  a  feasible 
plan  to  maximize  the  mission’s  average  task  accuracy.  Figure  1  shows  the  task  graph  for 
Area  A.  A  similar  graph  is  specified  for  Area  B. 

Multi-level  Asset  Task  Modeling  Paradigm 

Our  experimental  model  consisted  of  the  following  entities. 

Human-Players  (Decision  Makers-DM):  The  human  players  set  the  overall  desired 
accuracy  or  %  completion  for  each  task  T,  and  assign  Task  Forces  (TFs)  to  accomplish  the 
tasks.  Each  human  player  is  assigned  a  list  of  tasks  for  which  they  are  responsible.  The 
FOPS  players  are  grouped  into  a  team  of  four  players,  where  each  player  is  responsible 
for  planning  on  day  (T+l)  or  day  (T+2),  Area  A  or  Area  B.  T  varied  from  0  to  5. 

Tasks:  A  task,  which  is  derived  from  mission  decomposition,  is  an  activity  that  requires 
relevant  resources  to  be  processed.  The  tasks  are  carried  out  by  a  DM  under  certain 
mission  objectives.  In  our  model,  we  characterize  a  task  i  ( i  =  1,2,..., 7),  where  I  is  the 
total  number  of  tasks,  by  specifying  the  following  attributes: 

1)  ts,i  =  start  time  of  task  i ; 

2)  tpj  =  processing  time  of  task  i; 

3)  pi  =  priority  of  task  i. 

4)  lpci=  [xjoci,  y_loci ]  =  x-y  coordinates  of  the  geographic  location  of  task  i; 

5)  Ri  =  [Rn,.  .  •  ,  Rim]  =  resource  requirement  vector,  where  Rm,  is  the  number  of  units 
of  warfare  area  m  (m  =  1,  2, . . ,  M)  required  for  successful  processing  of  task  i. 

Task  Force  (TF):  A  Task  Force  (TF)  is  a  physical  entity  with  given  asset  capabilities  and 
is  used  to  process  the  tasks.  Each  Task  Force  k  (k  =  1,2, ...70,  is  a  composition  of  assets, 
with  the  following  attributes: 

1)  loct  =  [x_lock,  y_lock ]  =  x-y  coordinates  of  the  geographic  location  of  TF  k; 

2)  mgjc  =  [ mgki rngm ]  =  coverage  range  of  warfare  area  m. 

Assets:  An  asset  Aki  (/  =  1,  . . .,  L)  is  a  physical  entity  with  given  resource  capabilities  and 
is  a  decomposition  of  TF  k.  For  each  asset,  we  define  the  attributes  as  follows: 

1)  ry=  [r«i,.  .  .  Jum]  =  resource  capability  vector,  where  r«m  is  the  number  of  units 
of  warfare  area  m  possessed  by  asset  Aki; 

2)  max  warfare  tasks ti  =  [max_warfare_taskskn , . . .  ,max_warfare_taskskiM\  = 

concurrent  tasking  constraints  based  on  the  warfare  areas,  that  is,  an  asset  Aki  may 
be  involved  in  at  most  max_warfare_taskskim  tasks  in  a  given  warfare  area  m. 


Resource  Quantity:  A  resource  quantity  p  (p=  1,...,  P)  is  a  virtual  entity  with  given 
capabilities  akimp  in  a  particular  warfare  area  m  and  is  a  subdecomposition  of  an  asset  A«. 
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The  number  of  resources  allocated  to  a  particular  task  in  a  particular  warfare  category  was 
limited  by  the  tasking  constraint. 

Warfare  Area:  Warfare  areas  represent  functional  categorization  of  resources,  e.g, 
Command  and  Control  (C2),  Strike,  Intelligence  Surveillance  and  Reconnaissance  on 
ground.  Categorization  of  resources  into  warfare  areas  provides  a  common  language  to 
specify  task  requirements  and  asset  capabilities.  That  is,  each  task  is  specified  by 
resource  requirements  in  each  functional  warfare  area  and  each  asset  provides  resource 
capabilities  (including  zero)  in  each  warfare  area. 


Assets 


Level  1 
(TF-A) 


Level  1 
(TF-F) 


Organization  Hierarchy 

In  this  experiment,  we  assumed  an  organizational  hierarchy.  Level  0  is  the  top  level 
(Human  Player/DM);  Level  1  comprises  the  TF;  level  2  are  the  assets  within  individual 
TFs.  DM  indicates  the  command  cell  at  root  level  0  (e.g.,  staff  organized  as  a  MOC), 
gives  orders  and  assigns  tasks  to  task  forces  (technically  via  his  subordinate  commanders) 
at  level  1 ;  these  indicate  the  set  of  assets  at  level  1  that  receive  their  orders  from  the  MOC 
DM.  These  are  the  Task  Forces  immediately  subordinate  to  the  MOC,  e.g.  an  ESG,  CSG, 
destroyer  squadron,  etc.  A  commander  at  level  1  (including  respective  staff)  gives  orders 
and  assigns  tasks  to  forces  at  level  2.  The  set  of  assets  at  level  2  receive  their  orders  from 
commanders  at  level  1 .  The  assets  at  level  2  are  the  decomposition  of  an  asset  at  level  1 
into  components.  Thus,  each  level  1  asset  is  an  asset  grouping,  e.g.,  CSG  (TF-A),  and 
each  level  2  asset,  e.g.,  CG,  DDG  is  an  individual  asset,  etc.  The  individual  asset  at  level 
2  can  be  further  subdivided  into  virtual  assets  or  resource  quantity.  The  resource 
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quantities  are  allocated  to  tasks  subject  to  the  mission  constraints.  Thus,  an  asset  at  level 
2,  e.g.,  CG,  can  be  involved  in  a  STRIKE  mission  as  well  as  a  command  and  control 
mission  simultaneously  as  well  as  a  task  can  have  a  CG  assigned  to  it  and  a  CVN 
assigned  to  it  simultaneously.  Figure  1  shows  the  overall  mission  plan  or  course  of  action 
(COA)  that  is  being  operationalized  by  the  MOC  for  Area  A.  Figure  2  shows  the 
organization  hierarchy  used  in  the  experiment. 

Supporting-Supported  Relationships 

In  our  previous  research  [10],  it  was  stated  that  a  single  asset  could  only  be  assigned  to  a 
single  (responsible)  task,  although  a  task  could  be  assigned  to  more  than  one  asset.  In 
order  to  have  an  asset  assigned  to  more  than  one  task,  it  is  necessary  to  introduce  the 
concept  of  supporting-supported,  or  a  primary  and  secondary  asset  (or  TF).  There  is  only 
one  primary  TF  or  asset,  but  there  could  be  several  secondary  TFs.  At  level  0,  DM0  could 
assign  a  task  T4  to  A3  as  the  primary  (supported)  asset,  but  could  also  assign  the  same  task 
T4  to  Ai  as  a  supporting  asset  for  specific  warfare  areas.  Moreover,  DM1  will  have  at  his 
disposal  (or  can  request)  assets  used  by  DM0  when  he  allocates  the  task  T\  to  asset  A3’s 
resources  quantities.  This  leads  to  inter-asset  coordination  and  collaboration  in  processing 
task  T\.  Although  the  primary  Task  Force  might  be  the  first  choice  to  get  allocated  for  the 
responsible  task,  the  supporting  Task  Force  could  always  come  to  the  rescue  for  the 
warfare  categories  which  might  be  out  of  range  or  unavailable  to  the  primary  Task  Force. 
The  supporting  relationships  could  be  changed  from  one  decision  epoch  to  the  next, 
depending  on  other  (unanticipated)  events.  The  primary  or  the  supported  Task  Force  for 
any  task  should  be  fixed  for  that  task  throughout  the  experiment  [4], 


III.  Agent  Problem  Formulation 


The  mission  can  be  decomposed  into  a  set  of  tasks  that  entails  the  use  of  relevant 
resources  and  is  carried  out  by  a  Task  Force  (TF)  or  a  group  of  TFs.  Consequently,  the 
mission  goal  can  be  achieved  by  accomplishing  all  the  tasks  in  a  sequential  or  parallel 
manner  according  to  the  interrelationships  in  the  task  graph.  In  the  MOC-2  experiment 
[4],  the  human  players  specify  the  desired  tasks  performance,  which  is  defined  as  either  in 
terms  of  task  accuracy  or  %  task  completion.  If  the  asset  allocation  is  such  that  all  the 
tasks  can  reach  the  desired  performance,  then  the  planning  objective  is  said  to  have  been 
maximized.  The  task  requirement  is  a  vector  of  resource  categories.  Ideally,  if  assigned 
resources  match  the  required  resources  perfectly  for  all  the  warfare  areas,  it  reaches  the 
desired  performance  level.  If  there  is  a  mismatch  between  task  requirements  and  allocated 
resources,  due  to  Task  Forces  geographic  coverage  constraints  or  scarcity  of  assets,  task 
performance  is  less  than  desired.  We  adopt  the  definition  of  task  accuracy  ( Acc )  in  [1]  as 
follows: 


Acc(i)  =  <r(oj  [  min 


Acc 


upper 9 


E  E  E 

keprmr(i)uscnd(i )  leL(k)  peP(k,l,m) 


^ klmp  ^ iklmp 


R 


(1) 


where  m  is  the  index  of  the  warfare  area;  k  is  the  index  of  the  Task  Force;  y(i)  denotes  the 
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set  of  warfare  areas  which  task  i  requires,  i.e., (/?,,„  >  0);  ly(i)l  is  the  cardinality  of  y(i); 
AccUpper  denotes  the  upper  bound  on  accuracy;  a kimp  denotes  the  number  of  resources  the 
resource  quantity/sub-asset  owns;  zikimp  is  the  assignment  variable  denoting  the  status  of 
assignment  of  task  i  to  Task  Force  k’s  level  2  asset  l  in  warfare  area  m  with  resource 
quantity  index  p,  e.g.,  Figure  3  shows  an  example  of  multi-level  asset-task  allocation. 


Task 


Warfare  Area 
Category 


Resource 

Quantity 

(Sub-platform) 


Asset 

(Platform) 


Task  Force 


(TF) 


in  B 


ATTK  AIR 
BASES 


ISR-S(4) 

C2(3) 

C2(15) 

ISR-G(12) 


Figure  3  Multi-level  Asset-Task  Allocation 


Here,  3  units  of  TF-A’s  t  CVN-l’s  capabilities  in  C2  warfare  area  are  assigned  to  the  task 
CVN  PENETRATE;  prmrii)  is  the  primary  (supported)  Task  Force  for  a  task  7 ;  scnd(i ) 
is  the  set  of  secondary  (supporting)  Task  Forces  for  a  task  7) ;  l  is  the  index  of  the  level  2 
asset  e.g.  CG;  L(k)  is  the  set  of  level  2  assets  belong  to  TF  k,  e.g.,  CG-1  that  TF-A;  p  is 
the  index  of  the  resource  quantity;  P  (k,  l,  m)  is  the  set  of  resource  quantities  that  belong 
to  asset  Aki  in  a  warfare  area  m;  Rim  is  the  task  7  requirement  for  warfare  area  to.  It  is 
evident  that  accuracy  is  a  monotone  increasing  function  of  assigned  resources,  i.e.,  as 
more  resources  are  assigned  to  a  task,  higher  is  the  execution  accuracy  of  the  task.  If  any 
warfare  area’s  resources  are  missing,  the  task  has  zero  accuracy  and  thus  cannot  be 
processed. 

The  AccUpper  limits  the  maximal  impact  of  one  warfare  area  on  the  task’s  accuracy.  The 
upper  limit  on  accuracy  in  each  warfare  category  is  usually  set  as  100  %  or  higher  e.g., 
(200%  in  MOC  experiment).  Note  that  a  task’s  performance  cannot  be  improved  by 
adding  only  one  kind  of  warfare  resource.  Instead,  a  balance  on  all  the  resource  categories 
(warfare  areas)  is  preferred. 
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Another  criterion  of  tasks  performance  is  percentage  completion.  At  any  day  T,  let  C(7) 
be  the  percent  (%)  completion.  Then, 


C(T) 


c(r-i)+ioo 


o  ifr  =  -i 

AcciT ) 


otherwise 


(2) 


where  C(T)  is  the  %  completion  of  the  task  on  day  T.  Note  that  this  is  a  purely  linear 
charging/completion  model  with  completion  rate  100  *  Acc(T)/tp  :  so  if  AcciT)  =  1,  tp  = 
1,  and  C(T  -  1)  =  0  = >C(T)  =  100.  Note  that  once  desired  percentage  completion  is  given, 
the  corresponding  percent  accuracy  can  be  calculated  easily. 

We  formulate  the  asset-task  allocation  problem  as  one  of  minimizing  the  weighted  (by 
task  priorities)  average  difference  between  the  tasks’  desired  performance  and  the  actual 
performance  based  on  the  resource  allocation.  Formally, 


obj:  min  £/?. 

i= 1 


1 

1/(01 


I'  I  S  I 

me/(0  kGprmr(i)'Uscnd(i)  leL(k)  pGP(k,l,m) 


^ klmp  ^ iklmp 


R, 


-  Acc.  (i)  I 


(3) 


Note  that  there  exist  constraints  at  the  resource,  asset  and  TF  levels.  Define  the  asset-to- 
task  per  warfare  area  assignment  as 


1 


y  iklm 


o 


if  Z  Z'klmp>0 

peP(k,l,m) 

if  Z  ^  iklmp  ~  ff 

p^P{k,l,m) 


(4) 


Note  that  the  function  y,«m  izmmp)  is  a  nonlinear  function  of  zmmp-  Since  the  variables  are 
binary,  we  can  write  the  relationships  between  y;jym  and  zwmp  as 


I 

pGP(k,l,m) 


Oi  7 

klmp  ^  iklmp 


—  y  iklm 


(5) 


'  klm 


The  multi-level  asset  planning  problem  can  be  thus  formulated  as: 

obj :  min  X  A  0^  Z  '  Accn {i)  ~  71  Z  Z 


Oi  7 

klmp  ^  iklmp 


mG/(i) 


kGprmr(i)'Uscndii)  l&L(k)  p&P(k,l,m ) 


R 
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^  1  ^ klmp  ^  iklmp 


S.t 


pGP(k,l,m) 


rklm 


^  yikim  v  U  k,  l  and  m ; 


M 

T,ymm^Mxm  V  Uk,k 


m= 1 


y  y  xM  <  max_assets  V  i  ; 

kGprmr(i)uscnd(i )  l<=L(k) 

I 

y  xiW  <  max_tasks  V  k  and  /; 

;=i 

/ 

X  ^  max  _warfare_tasksHm  V  k,  /  and  m; 

i=l 

z(jHmp  =0  Vi,  k  e  scndii),  l  e  L(k),  m  e  e  P(k,l,m )  ; 

Zittep  =0  V  k,  1  <  /  <  L(k),  V  m,  p  e  P(k,l,m),  i  e  g(k,m)  ; 

**  e  (0,1),  ziHmp  e  (0,1),  y,.Hm  e  (0,1). 


(6) 


where  (j)(k,  i)  is  the  set  of  resource  categories  that  secondary  TFk  cannot  support;  C,  (k,  m) 
is  the  set  of  tasks  7)  which  is  not  in  the  range  of  the  asset  Am  for  a  resource  category  m; 
Accdd)  is  the  desired  accuracy  for  the  task. 

IV.  Dynamic  List  Planning  Method 


Figure  4  Illustration  of  Dynamic  List  Planning  Method 


The  planning  problem  is  a  multi-level  asset-task  assignment  problem.  The  number  of 
inequality  constraints  is  I  *  K  *  L(k )  *  |y(/)|  +  I  *  K  *  L(k )  +  I  +  K  *  L(k )  +  K  *  L(k )  * 
ly(i)l,  is  approximately  3000  and  the  number  of  decision  variables  are  approximately 
2000  for  MOC-2  experimental  scenario,  which  makes  it  impossible  to  find  the  optimal 
solution  in  a  few  seconds.  Instead,  efficient  sub-optimal  solutions  are  preferred. 

Here,  we  proposed  an  approach  that  provides  very  good  quality  near-optimal  solutions, 
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termed  the  Dynamic  List  Planning  method.  The  key  idea  is  to  plan  tasks  sequentially 
based  on  dynamic  task  priorities,  which  are  adjusted  based  on  the  current  resource 
distribution.  The  main  flow  of  the  Dynamic  List  Planning  method  is  shown  in  Figure  4. 
At  the  beginning,  there  is  a  pool  of  tasks  which  needs  to  be  processed.  The  algorithm 
deals  with  one  task  a  time  according  to  the  order  in  the  task  list.  After  assigning  resources 
to  the  top  task  in  the  list,  the  algorithm  reprioritizes  the  tasks  in  the  list  based  on  their 
requirements  and  the  current  assignment. 


The  dynamic  rank  (priority)  of  a  task  is  defined  as 


rankii )  = 


J pi  |  Acc(i)  —  Accd  (/)|  if  Acc(i )  <  Accd  (i) 
[  0  otherwise 


(7) 


Note  that  Acc(i )  is  increased  when  more  resources  are  assigned.  Therefore,  for  two  tasks 
with  the  same  priorities,  the  one  with  inadequately  assigned  resources  will  be  listed  at  the 
top.  On  the  other  hand,  two  tasks  with  the  same  difference  in  accuracies,  the  one  with  a 
higher  priority  will  be  selected  for  the  next  planning  phase.  Our  asset  selection  involves 
two  criteria.  The  first  one  evaluates  the  accuracy  assuming  that  all  the  allowable  resources 
from  the  asset  are  allocated,  and  chooses  the  asset  that  provides  the  maximum  accuracy. 
The  second  one  evaluates  the  desirability  of  Asset  Am  using: 


( 


resources  from  Asset  Akl 


already  assigned  resources 


A 


Z 

mey(i) 


mm(Accd(i)Riin,  I  +  s  E  z  ^ kump  ^ ikump  ) 

peP(k,l,m )  k^prmr{i)^Jscnd{i)u^L{k)  peP(k,u,m ) 

Acc,  (0 - - - - - 


(8) 


V 


) 


In  the  asset  selection,  the  first  criterion  is  employed.  If  more  than  one  asset  is  needed,  the 
second  criterion  is  applied.  After  selecting  the  most  suitable  asset  Am,  the  resource 
allocation  problem  is  solved  via: 

obj :  min  I  £  (i) , 

p<EP(k,l,m )  P-im 

(9) 

s.t  ziklmp=  0  if  k  g  scnd(i),  mG(f>(k,i),  p  &P(k,l,m) 

Zikimp  =  0  P  e  P(k,l,m),  i  e  C(k,m );  zUmp  e  (0,1), 

where  Accr(i )  is  the  adjusted  accuracy,  defined  as  the  desired  accuracy  minus  the  assigned 
resources  from  pervious  iteration. 

Accr(i)  =  Accd  (i)  -  X  Z  Z  atZZltmv  (10) 

kGprmr(i)uscnd (i)  uGL(k)  pGP(k,u,m)  ^im 
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This  resource  allocation  problem  can  be  solved  via  greedy  search.  The  procedure  is 
shown  in  Table  1. 


Greedy  Search: 

1 .  Calculate  the  remaining  resource  requirement  R  ’im=Accr(j)*Rim. 

2.  Scan  all  the  allowable  resource  quantities,  rank  them  based  on  IT?  ’im-akimp\  in  ascending 
order 

3.  Allocate  the  first  resource  quantity  p  ’  to  the  task. 

4.  Calculate  T?  \m  =  R  ’im  -  a kimp>.  If  R  ’im<0,  quit;  otherwise,  go  to  step  2. 


Table  1  Procedure  of  Greedy  search  for  Resource  Quantity  Allocation  Problem 

The  procedure  for  the  Dynamic  List  Planning  method  is  shown  in  Table  2. 

V.  Software  Design  and  Algorithm  Performances 

The  agent-based  distributed  planning  model  provides  a  flexible  and  controllable  multi¬ 
player,  real  time  planning  environment  to  support  laboratory-based  empirical  experiments 
in  a  Windows  environment  to  study  the  interactions  and  the  planning  processes  in  a  MOC 
architecture.  The  architecture  allows  for  manipulation  of  organizational  structures,  such  as 
authority,  information,  communication,  resource  ownership,  task  assignment,  etc.,  as  well 
as  mission  and  environmental  structures.  The  experimental  framework  involved  a  team  of 


Dynamic  List  Planning  Method: 

1.  Initially,  create  the  task  list  with  each  task  TVs  rank(i)=  pi*Accd(i). 

2.  Choose  the  task  Tv  with  the  highest  rank,  call  the  planning  phase 

a.  Check  each  asset’s  allowable  resources. 

b.  Rank  the  assets  based  on  the  accuracy  if  the  particular  asset  assigned  to  task  Tv 

c.  Select  the  top  asset,  if  the  corresponding  accuracy  is  zero  or  same  as  the  second 
asset,  go  to  step  2-d,  otherwise,  go  to  step  2-e. 

d.  Rank  the  assets  based  on  Eq.  8,  choose  the  top  asset. 

e.  Apply  the  greedy  search  to  find  the  resource  quantity  allocation 

3.  Update  the  rank  of  task  Tv  rank(V)=  pi>*\Accd(i')-  Acc(i')\  if  Accd(i')  >  Acc(Z'), 
otherwise,  rank(V)= 0 

4.  Check  the  terminal  criteria 

a.  If  all  the  tasks  have  reached  the  maximal  number  of  assets,  if  true,  go  to  step  5, 
otherwise,  go  to  step  4-b. 

b.  If  all  the  tasks  have  explored  all  the  allowable  assets,  if  true,  go  to  step  5, 
otherwise,  go  to  step  2. 

5.  Add/Drop  heuristic  process  to  improve  the  objective  function 

Table  2  Procedure  of  Dynamic  List  Planning  Method 
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decision-makers  (DMs)  in  a  hierarchical  or  networked  organization  to  simulate  a  military 
operation.  The  players  had  operational  capabilities  to  plan  an  operational  level  task  by 
assigning  high  level  Task  Forces  that  control  the  necessary  resources  to  execute  a  set  of 
assigned  mission  tasks,  provided  that  such  task  execution  does  not  violate  the  Task 
Force’s  concomitant  resource  capability  thresholds.  During  the  course  of  the  experiment, 
a  DM  was  able  to  plan  and  re-plan  ongoing  tasks  for  the  next  time  epoch  by  modifying 
the  current  assignment  to  increase  team  performance  based  on  his  expertise  and  the 
current  updates  from  the  battlefield.  The  designed  architecture  supported  collaboration 
because  the  information  needed  to  pursue  the  joint  goal  was  beyond  the  capability, 
knowledge  or  capacity  of  any  individual  player.  The  architecture  also  has  the  facilities  to 
acknowledge  the  dynamic  updates  from  the  battlefield. 

Planning  Module 

The  networked  distributed  coordinated  framework  involved  human  players  to  establish 
joint  or  individual  commitments  to  tasks,  to  monitor  the  execution  of  tasks,  acknowledge 
the  true  information  from  the  battlefield,  to  broadcast  task  performance  and  to  re-plan  the 
task,  if  necessary.  The  initial  static  data  for  the  experiment  populated  the  administrator 
terminal.  This  experiment  had  4  Future  Operations  (FOPS)  terminals,  one  Current 
Operations  (COPS)  terminal  and  an  experimenter  or  administrator  terminal.  Figure  5 
shows  the  block  diagram  of  the  planning  module  used  in  the  2010  MOC-2  experiment. 
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Figure  5  Distributed  Planning  Module  Architecture 

Multi-Level  Asset  Allocation  Model:  Experimental  Setup 

The  multi-level  asset  allocation  decision  support  model  was  used  in  the  MOC-2 
experiment  conducted  at  Naval  Postgraduate  School  (NPS).  The  experiment  was  set-up 
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with  four  Future  Operation  players  (FOPS)  and  one  Current  Operation  player  (COPS) 
and  an  administrator  to  mimic  the  functionalities  of  the  MOC  director.  The  administrator 
at  the  server  terminal  controlled  the  experiment,  which  involved  planning  in  two 
geographical  areas  Area  A  and  Area  B  and  four  play  sessions.  The  software  supported 
Integrated  (centralized)  and  Isolated  (decentralized)  team  structures.  It  also  supported 
situational  reports  (SITREPS)  from  the  battlefield.  The  software  has  the  following  tabs: 

(1)  Summary  Screen:  The  summary  screen  provides  aggregated  planning  information  to 
the  players  on  all  active  tasks  for  the  planning  period.  It  displays  the  task  name,  task 
priority,  responsible  DM  (a  responsible  Decision  Maker  is  the  one  who  can  plan  for  the 
tasks  for  that  day;  responsibilities  may  or  may  not  change  over  time);  primary  Task  Force 
(TF);  secondary  TF;  criteria  (can  be  %  completion  or  accuracy):  desired,  expected  and 
actual  performance.  The  active  tasks  are  white,  while  the  inactive  tasks  are  grayed  out. 
Figure  6  shows  the  summary  screen  for  the  planning  software. 


Figure  6  Summary  Screen  of  the  2010  MOC-2  Experiment  Software 


(2)  Task  Status  Screen:  The  task  status  screen  shows  status  (whether  the  task  is  started  or 
not)  and  the  requirement  vector  for  all  the  tasks.  It  shows  the  requirement  for  100% 
accuracy  criterion.  It  can  be  used  as  a  reference  by  the  human  planners. 

1$)  MOC-Experiment '  Team  A '  Integrated  #  Day  0  »•  ••  l"0"!'  B 

File  CurrentTimePeriod  T  =  0  [  Refresh  ]  (  Get  DB  Data  ]  [  Start_Exp 
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Figure  7  Task  Status  Screen  of  the  2010  MOC-2  Experiment  Software 
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(3)  Asset  Status  Screen:  The  asset  status  screen  shows  the  total  capabilities  of  the  Task 
Force.  It  also  displays  the  individual  capabilities  of  each  asset  belonging  to  the  Task 
Force.  This  display  supports  the  situational  reports  sent  by  the  COPS.  The  grayed  out 
assets  have  either  not  arrived  in  the  theater  or  are  unavailable.  To  show  the  health  of  the 
Task  Force,  we  have  a  stop  light  besides  each  Task  Force.  The  messages  from  the  COPS 
player  can  be  updated  using  the  update  button  and  entering  the  code  sent  in  by  the  COPS 
player. 
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Figure  8  Asset  Status  Screen  of  the  2010  MOC-2  Experiment  Software 
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(4)  Assignment  Screen:  The  assignment  screen  is  used  by  the  planners  to  specify  the 
desired  performance  based  on  their  area  of  responsibility;  the  primary  Task  Force;  the 
supporting  (secondary)  Task  Force;  and  the  supporting  warfare  areas  that  the  secondary 
Task  Force  will  be  involved  in  for  all  the  active  tasks.  Figure  9  shows  the  assignment 
screen  for  the  planning  software.  The  assignment  page  shows  expected  performance 
returned  by  the  planning  agent  if  the  plan  is  submitted.  It  shows  the  total  capability  of 
each  Task  Force;  the  Task  Force’s  available  capability  (this  is  the  capability  which  is 
available  for  the  task  selected);  last  assigned  by  TF  (indicates  the  allocated  capabilities  by 
the  TFs  to  this  task).  On  clicking  the  last  assigned  by  TF,  we  can  also  see  the  assets,  their 
capability  in  each  warfare  category  being  assigned  to  the  particular  task.  If  in  a  particular 
warfare  category,  the  capability  is  shown  as  ”X”,  it  means  that  the  particular  warfare 
category  is  out  of  range  for  the  selected  task.  The  estimated  task  requirement  for  the 
’desired’  is  also  shown;  it  corresponds  to  the  requirement  vector  for  the  selected  task  to 
meet  the  desired  performance.  It  changes  based  on  the  desired  performance  chosen.  The 
difference  and  the  mismatch  at  the  bottom  show  the  difference  in  task  requirements  and 
the  total  allocated  capabilities  from  all  assigned  task  forces. 
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Figure  9  Assignment  Screen  of  the  2010  MOC-2  Experiment  Software 


Results 

The  Dynamic  List  Planning  method  was  applied  to  the  experimental  mission  scenario 
designed  by  NPS.  Since  the  constraints  exist  on  task,  warfare  area,  resource  quantity, 
asset  and  Task  Force,  the  information  related  to  the  five  levels  are  required.  Thus,  the 
decision  variable  had  high  dimensions  and  the  size  was  up  to  around  2000  per  day.  The 
constraints  included  the  tasks  per  asset,  tasks  per  asset  per  warfare  area,  assets  per  task, 
supporting  warfare  areas  and  geographic  range  constraints.  Meanwhile,  there  are  up  to 
around  3000  inequality  constraints  per  day.  Due  to  the  large  number  of  decision  variables 
and  constraints,  the  allocation  problem  was  formulated  into  a  large  scale  linear  integer 
programming  problem,  which  cannot  be  solved  in  polynomial  time  (combinatorial 
optimization  problem).  The  exact  algorithm,  Branch  and  Bound  algorithm  has  run  time 
that  spans  days  for  a  one  day  plan. 
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Figure  10  Desired  vs.  Expected  Performance  (Accuracy  or  %  Completion) 

We  conducted  computational  efficiency  and  allocation  performance  tests  based  on  the 
MOC-2  experiment  scenario,  set  up  the  desired  performance  as  default  values  (97%  as 
accuracy  or  100%/^  as  %  completion)  and  assigned  TFs  subject  to  the  TF  constraints, 
which  includes:  1)  The  primary  TF  for  any  task  should  be  fixed  for  that  task  throughout 
the  experiment;  2)  A  task  can  have  only  one  primary  TF  assigned  to  it  and  at  most  two 
supporting  TF  in  at  most  two  warfare  areas;  3)  one  TF  cannot  be  primary  TF  for  more 
than  4  tasks;  4)  one  TF  cannot  be  secondary  TF  for  more  than  3  tasks.  We  applied  our 
Dynamic  List  Planning  method  to  6  planning  problems  corresponding  to  the  planning 
sessions  Day  0  through  5.  The  tasks  per  day  varied  from  3  to  14.  In  Figure  10,  we 
represent  the  desired  performances  and  expected  performances.  We  also  compute  the 
difference  between  the  two  in  terms  of  overkill  (excess  force  to  destroy  the  enemy  target) 
and  underkill  (insufficient  force  to  defeat  an  enemy).  The  average  deviation  from  the 
desired  performance  is  6.61%,  and  2.49%  as  average  underkill ,  4.11%  as  average  overkill. 
Note  that  some  of  the  underkill  result  from  insufficient  resources  or  asset  breakdowns. 
Besides  its  near  optimality,  our  approach  took  less  than  10  sec  per  planning  session 
compared  to  an  estimated  40  days  of  computing  time  by  exhaustive  search. 

VI.  Summary 

This  paper  provided  an  overview  of  a  multi-level  asset  allocation  model  including:  1)  a 
mathematical  formulation  of  the  multi-level  asset  allocation  problem  and  a  near-optimal 
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algorithm  to  solve  the  problem;  2)  a  distributed  networked  architecture  to  support  the 
operational  level  planning  process  for  different  team  structures  (integrated  and  isolated). 
Our  mixed  initiative  asset  allocation  algorithm  operates  in  real-time  subject  to  a  number 
of  realistic  planning  constraints.  The  collaborative,  multi-player  planning  software 
supported  the  MOC  experiments  at  NPS.  We  presented  this  model’s  application  to  a 
mission  scenario  in  the  MOC-2  experiment  and  the  performance  of  the  Dynamic  List 
Planning  method  on  the  asset  allocation  problem  arising  in  the  MOC-2  planning 
experiment.  The  experimental  results  demonstrate  that  the  Dynamic  List  Planning  method 
is  a  highly  efficient  near-optimal  solution  for  complex  multi-level  asset  allocation 
problems.  The  Dynamic  List  Planning  algorithm,  when  embedded  in  the  collaborative 
planning  software,  provided  a  mixed  initiative  decision  support  tool  for  operational  level 
planning.  Our  future  research  will  focus  on  decision  support  software  involving 
assessment,  evaluation  and  analysis  of  weather  impacts  on  operational  level  planning. 


REFERENCES 

[1]  H.  Bui,  X.  Han,  S.  Mandal,  K.  R.  Pattipati,  and  D.  L.  Kleinman,  “Optimization- 

based  decision  support  algorithms  for  a  team-in-the  loop  planning  experiment”,  In 
Proceedings  of  the  IEEE  International  Conference  on  Systems,  Man  and 
Cybernetics ,  San  Antonio,  TX,  October  2009. 

[2]  United  State  Fleet  Forces  Command.  2007.  Maritime  Headquarters  with  Maritime 

Operations  Center  Concept  of  Operations  -  An  Enabling  Concept  for  Maritime 
Command  and  Control. 

[3]  S.  G.  Hutchins,  W.  G.  Kemple,  D.  L.  Kleinman,  S.  Miller,  K.  Pfeiffer,  S.  Weil,  Z. 

Horn,  M.  Puglisi,  and  E.  Entin,  “Maritime  headquarters  with  maritime  operations 
center:  A  research  agenda  for  experimentation”,  In  Proceedings  of  the  14th 
International  Command  and  Control  Research  and  Technology  Symposium, 
Washington,  D.C.,  June  2009. 

[4]  S.  G.  Hutchins,  W.  G.  Kemple,  D.  L.  Kleinman,  S.  Miller,  K.  Pfeiffer,  Z.  Horn,  S. 

Weil,  and  E.  Entin,  “Maritime  operations  centers  with  integrated  and  isolated 
planning  teams”,  International  Command  and  Control  Research  and  Technology 
Symposium,  Santa  Monica,  CA,  June  2010. 

[5]  H.  W.  Kuhn,  “The  Hungarian  method  for  the  assignment  problem,”  Naval  Research 

Logistics,  vol.  52,  pp.  7-21,  October  2004. 

[6]  D.P.  Bertsekas,  “Introduction  to  linear  optimization”,  Athena  Scientific,  Belmont, 

MA  1997. 

[7]  Levchuk,  G.  M.,  Y.  N.  Levchuk,  J.  Luo,  K.  R.  Pattipati,  and  D.  L.  Kleinman.  2002. 

Normative  Design  of  Organizations-Part  I:  Mission  Planning.  In  IEEE  Trans.  Syst., 
Man,  Cybern.  A,  vol.  32:  346-359. 


18 


16th  ICCRTS:  Collective  C2  in  Multinational  Civil-Military  Operations 


[8]  Levchuk,  G.  M.,  Y.  N.  Levchuk,  J.  Luo,  K.  R.  Pattipati,  and  D.  L.  Kleinman.  2002. 

Normative  Design  of  Organizations-Part  II:  Organizational  Structure.  In  IEEE 
Trans.  Syst.,  Man,  Cybern.  A,  vol.  32:  360-375. 

[9]  Levchuk,  G.  M.,  Y.  N.  Levchuk,  C.  Medina,  K.  R.  Pattipati,  and  D.  L.  Kleinman. 

2004.  Normative  Design  of  Organizations-Part  III:  Modeling  Congruent,  Robust, 
and  Adaptive  Organizations.  In  IEEE  Trans.  Syst.,  Man,  Cybern.  A,  vol.  34:  337- 
350. 

[10]  S.  Mandal,  X.  Han,  K.  R.  Pattipati,  and  D.  L.  Kleinman,  “Agent-based  distributed 

framework  for  collaborative  planning”,  IEEE  Aerospace  Conference,  Big  Sky,  MN. 
March  2010. 


19 


An  Optimization-based  Multi-level  Asset 
Allocation  Model  for  Collaborative  Planning 


Xu  Han 

Suvasri  Mandal 
Huy  Bui 

Diego  Fernando  Martinez  Ayala 
David  Sidoti 
Manisha  Mishra 

Prof.  David  L.  Kleinman 
Prof.  Krishna  R.  Pattipati 

Dept,  of  Electrical  and  Computer  Engineering 
University  of  Connecticut 
Tel. /Fax:  (860)  486-2890/5585 
E-mail:  krishna@enqr.uconn.edu 


June  21-23,  2011 


■  Introduction 


Outline 


j 


■  Mission  scenario  in  MOC-2010  experiment 


^  ■  Force  structure 

%  ■  Mission  and  task  graph 


■  Collaborative  planning  module 

■  Overall  framework 

■  Moving  time  horizon  planning 

■  Integrated  (shared  information)  and  isolated  team  structures 

■  Multi-level  asset  allocation  problem 

■  Problem  description 

■  Formulation 

■  Solution  approach 

■  Algorithm  performance 

■  Summary  and  future  work 


2 


Introduction 


Motivation: 


■  Networked  distributed  planning  capabilities  in  maritime  operations  centers  (MOC) 

■  Mixed-initiative  decision  making 

■  Multi-level  asset-to-task  allocation 

■  Planning/re-planning  based  on  dynamics  of  mission  environment 

■  Assessing  the  efficiency  and  planning  performance  of  integrated  and  isolated  team 
structures  (MOC-2010  experiment  at  NPS) 

■  Previous  research:  optimization-based  modules  for  MOC-2009  experiment 

■  Future  operations  (FOPS)  module 

■  Provide  a  list  of  A/-best  asset  packages  to  maximize  the  task  execution  accuracy 
subject  to  constraints  on  maximum  number  of  tasks  per  asset 

■  Current  operations  (COPS)  module 

■  Analysis  the  risk  of  redirecting  assets  from  an  ongoing  task  to  perform 
intelligence,  surveillance,  and  reconnaissance  (ISR)  tasks 

■  Scheduling  (offline)  module 

■  Assist  experimental  designer  to  set  the  conditions  for  the  mission  planning 
activity  (e.g.,  asset  types  and  numbers,  task  requirements  and  asset  capabilities) 

Q:  Can  we  develop  a  general  purpose  distributed  planning 
software  for  Team-in-the-loop  planning  experiments? 
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Mission  Scenario  for  MOC-2010  Experiment 
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Mission  Scenario  for  MQC-2010  Experiment 

Task  Graph(What  needs  to  done  by  what  time?) 


Day  0  Day  1  Day  2  Day  3  Day  4  Day  5 


o  Similar  mission  courses  of  action  (COA)  exists  for  Area  B 
o  Overall  <15  Tasks  per  Day 
o  25  Tasks  of  the  mission 


( ):  Precedence  task 
(task  #:  Accuracy  or  % 
Completion  desired) 


Force  Structure  for  MQC-2010  Experiment 

Planning  Hierarchy  (Specifies  who  does  what  and  with  which  resources) 


4  FOPS  at  Level  0:  Assign  Task  Forces  -  Tasks  with  Supporting-Supported  relationships 
with  a  desired  performance  criteria 

7  Task  Forces  at  Level  1 :  an  ESG,CSG,  etc.,  specified  with  a  geographical  location 
42  Assets  at  Level  2:  specified  with  an  arrival  time  to  denote  when  the  asset  engaged  to 
the  mission 

331  Resource  Quantities  at  level  3:  virtual  entities  with  specified  capabilities  of  each 
warfare  area,  e.g.,  C2,  STRK,  AW,  etc. 
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Collaborative  Planning  Module 


The  planning  module  interacts  with  human  players  to 

■  establish  joint  or  individual  commitments  to  tasks 

■  monitor  the  execution  of  tasks  and  acknowledge  the  latest  information 

■  broadcast  task  performance  and  to  re-plan  the  task 
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Multi-level  Asset  Task  Allocation 


Problem  Objective:  Minimize  the  cumulative  difference  between  the  desired 
performance(percentage  completion/accuracy  set  by  the  human  players)  and 
the  expected  performance(generated  by  the  planning  agent  based  on 
allocation)  over  all  the  tasks 
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Planning  Agent  Problem  Formulation 
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Solution  and  Results 


Dynamic  List  Planning  Method 
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Summary  and  Future  work 


Summary:  optimization-based  multi-level  asset  allocation  model 


■  Developed  an  interactive  human-in-the-loop  planning  tool  for  operational  level 
planning  among  different  team  structures 

■  Mixed  initiative  human  plus  agent  environment  for  laboratory  research 

■  The  tool  accommodates  the  real  world  challenges  -  information  transfer,  dynamic 
updates  from  the  battlefield 

■  Dynamic  list  planning  method  used  to  solve  the  multi-level  asset  allocation  problem 

■  Future  research 


■  Integrate  uncertainty  factors  in  operational  level  planning 

■  Weather  impacts  on  planning  included  in  MOC-2011  experiment 

■  Uncertainty  due  to  Logistics,  ISR  and  weapon  capabilities 

■  Incorporate  more  realistic  constraints 

■  Temporal  constraints:  asset  maintenance  and  refueling 

■  Multi-level  mission  representations 

■  Improve  agent’s  capabilities 

■  Develop  operational  level  agents  to  optimize  Task  Force  Assignment 

■  Scheduling  agents  to  determine  optimized  mission  progress  per  day 


